Embeddings & Vector DBs

Daniel Slutsky

Scicloj LLM Meetup #2

source: projects/vald/notebooks/scicloj/scrapbook/vald.clj

plan

  • keep our knowledge in a vector database
  • inject that into chats

some Knowledge

(def a-wikipedia-paragraph-about-bananas
  "By wikipedia:
 The banana fruits develop from the banana heart, in a large hanging cluster, made up of tiers (called \"hands\"), with up to 20 fruit to a tier. The hanging cluster is known as a bunch, comprising 3–20 tiers, or commercially as a \"banana stem\", and can weigh 30–50 kilograms (66–110 lb). Individual banana fruits (commonly known as a banana or \"finger\") average 125 grams (4+1⁄2 oz), of which approximately 75% is water and 25% dry matter (nutrient table, lower right).")

By wikipedia: The banana fruits develop from the banana heart, in a large hanging cluster, made up of tiers (called “hands”), with up to 20 fruit to a tier. The hanging cluster is known as a bunch, comprising 3–20 tiers, or commercially as a “banana stem”, and can weigh 30–50 kilograms (66–110 lb). Individual banana fruits (commonly known as a banana or “finger”) average 125 grams (4+1⁄2 oz), of which approximately 75% is water and 25% dry matter (nutrient table, lower right).

Using openai-clojure

(defonce create-embedding
  (memoize openai/create-embedding))
nil
(defonce create-chat-completion
  (memoize openai/create-chat-completion))
nil

chat completions

(create-chat-completion
 {:model "gpt-3.5-turbo"
  :messages [{:role "user"
              :content "What is the average weight of a banana fruit?"}]})
{:id "chatcmpl-7S43Cmej3gdxLRiyCAktyl3AjcvLp",
 :object "chat.completion",
 :created 1686923110,
 :model "gpt-3.5-turbo-0301",
 :usage {:prompt_tokens 18, :completion_tokens 18, :total_tokens 36},
 :choices
 [{:message
   {:role "assistant",
    :content
    "The average weight of a banana fruit is around 120 grams (4.2 ounces)."},
   :finish_reason "stop",
   :index 0}]}

chat completions based on some knowledge

(create-chat-completion
 {:model "gpt-3.5-turbo"
  :messages [{:role "system"
              :content a-wikipedia-paragraph-about-bananas}
             {:role "user"
              :content "What is the average weight of a banana fruit?"}]})
{:id "chatcmpl-7S43FX5MtIIaBpFR2dcIWavhGCu9m",
 :object "chat.completion",
 :created 1686923113,
 :model "gpt-3.5-turbo-0301",
 :usage {:prompt_tokens 147, :completion_tokens 20, :total_tokens 167},
 :choices
 [{:message
   {:role "assistant",
    :content
    "The average weight of a banana fruit is around 125 grams (4+1/2 oz)."},
   :finish_reason "stop",
   :index 0}]}

embeddings

(create-embedding
 {:model "text-embedding-ada-002"
  :input a-wikipedia-paragraph-about-bananas})
{:object "list",
 :data
 [{:object "embedding",
   :index 0,
   :embedding
   [-2.0334442E-4
    -0.018748498
    0.028601157
    5.390193E-4
    0.025097126
    -0.005349787
    -0.013731658
    0.009063928
    -0.021787047
    -0.023416227
    -0.002776717
    0.014235928
    -0.046185955
    -0.010751293
    -0.008566123
    0.027877076
    0.027877076
    -0.008805329
    -0.014442808
    -0.027204717
    -0.003112897
    -0.013046368
    -0.017106388
    0.024489416
    -0.002283761
    0.010828873
    0.032635316
    -0.019795828
    0.029738996
    -0.003287452
    0.009277274
    0.0044317567
    -0.018295947
    -3.5820136E-4
    -0.014740198
    0.005782942
    0.001954046
    0.0053465543
    -0.015709948
    -0.010395719
    0.018774357
    0.017390847
    -0.002063951
    -0.0016380692
    -0.029816575
    0.0049004694
    -0.0020300096
    -0.016408168
    -0.025200566
    0.020183727
    0.023299856
    0.026403056
    -0.018476967
    0.005201092
    -0.023455016
    -0.016938297
    -0.0034329146
    7.705471E-4
    4.7840993E-4
    -0.0058152666
    -0.009206159
    0.021877557
    -0.008688958
    -0.014029048
    -0.015865108
    -5.2002835E-4
    0.0052495794
    -0.021877557
    -0.007454144
    0.009826799
    -0.0014004804
    0.019873407
    -0.012354613
    0.0063809543
    0.015878038
    0.001773026
    -0.009587593
    0.0031161297
    -0.038453814
    -0.0040406245
    0.026170317
    -0.011514164
    -0.0065425793
    0.035376474
    -0.0013091624
    0.016925368
    -0.0044576167
    0.021799978
    0.0014214917
    -0.020106148
    -0.006697739
    0.005527574
    -0.003474937
    0.0011798623
    0.0060059843
    5.147756E-4
    -0.021864627
    0.012264104
    0.006917549
    -0.041582875
    -0.010977568
    0.0054144366
    -0.021722397
    -0.012257638
    -0.035092015
    0.006471464
    0.036591895
    -0.011805088
    0.007208474
    -0.042539693
    -0.012652003
    0.024967827
    -0.014727268
    -0.027825356
    -0.012496843
    -0.0082687335
    0.026506497
    0.019291557
    0.014404018
    -0.018800218
    0.031006135
    -0.0014271486
    0.023674827
    -0.003636562
    0.014248858
    0.010066004
    0.003397357
    -0.032661177
    -0.015218608
    -0.0048358194
    0.035428196
    -0.0016404935
    -0.012205918
    0.014248858
    8.012558E-4
    0.008766538
    -0.0037496996
    -0.006865829
    0.0034587744
    -0.018451108
    0.0128847435
    0.014222998
    -0.020338887
    -0.012593818
    -0.029480396
    0.018994167
    0.020778507
    0.044143014
    -4.8366273E-4
    -0.025769487
    0.011882668
    0.0047679367
    0.037548713
    -0.0038789995
    0.011145659
    0.0020413236
    -0.003227651
    0.010162978
    -0.0016291798
    0.008934629
    -0.0050200718
    0.005999519
    -0.013589428
    0.0034005896
    -0.003649492
    0.041738033
    -0.0041052746
    -0.012192989
    0.011501233
    -0.0100401435
    0.009917309
    0.026351336
    -0.007945484
    9.96418E-4
    0.026338406
    0.003727072
    2.8445997E-4
    -0.019976847
    -0.016304728
    -0.0016905973
    -0.016951228
    -0.0036785845
    -0.0012445123
    0.010964639
    -0.027825356
    -0.014740198
    0.014585038
    -0.015813388
    0.020636277
    -0.008100644
    -9.762149E-4
    0.002576302
    0.010492694
    0.004367107
    -0.6537407
    0.014378158
    0.017028807
    -0.011139194
    0.034057613
    0.019537227
    0.006930479
    0.0018360597
    -0.018709708
    -0.003326242
    -0.004864912
    -0.002542361
    0.015141028
    0.002440537
    -0.014985868
    -0.024347186
    -0.004599847
    -0.032014675
    -0.013511848
    0.0020623347
    -0.035712656
    0.024683367
    -0.009251414
    -0.0027734847
    -0.005042699
    -0.011669324
    0.018981237
    -0.0022304247
    -0.001624331
    0.020907806
    -0.005472622
    -7.458993E-4
    0.022575777
    0.040962234
    0.033824876
    0.0053206943
    -0.028575296
    0.008365708
    -0.0039695096
    0.022847306
    -0.010453903
    -0.009788008
    0.024941966
    -0.030204475
    -0.018451108
    8.638855E-4
    0.035609215
    -0.0041569946
    0.005595457
    -0.010906453
    0.004722682
    -0.008275199
    -5.2629133E-5
    -0.031031996
    -0.019692387
    0.015735807
    0.040470894
    0.0026538821
    -0.005430599
    -0.021851696
    -0.024618717
    -0.0060577043
    -0.028885616
    -0.0109387785
    -7.70143E-4
    0.021980997
    -0.010725434
    0.024941966
    0.024204956
    -0.012264104
    0.015412558
    0.004851982
    -0.003436147
    -0.0023564922
    0.020907806
    0.0018360597
    0.024230817
    -0.009548804
    -0.009529409
    0.011455978
    0.0026926722
    0.018360598
    0.018192507
    -0.004244272
    0.031264737
    0.0057085943
    -0.0030401659
    0.014804848
    0.0015136179
    -0.010492694
    0.014404018
    -0.0014020967
    0.006917549
    -0.008107109
    -0.0028882383
    0.011649928
    -0.038402095
    -0.013104553
    -0.028161537
    0.019692387
    -0.016899507
    -0.020662136
    -0.016214218
    -0.0013511848
    0.032143977
    0.008915233
    -0.051538974
    0.017856328
    0.043418933
    -0.026015157
    -0.017558938
    -0.0037884894
    -0.014817778
    0.003242197
    0.013576498
    -0.020338887
    -0.004884307
    0.004341247
    0.008986348
    -0.006613694
    0.036229856
    0.018425247
    0.015839247
    -0.010311673
    0.010137118
    0.0043961992
    0.0037044445
    -0.022743868
    -0.009025139
    -0.031394035
    0.003099967
    -0.009180299
    -0.0026571145
    -0.008404499
    0.034419656
    0.014429878
    -6.161952E-4
    -0.007408889
    0.012955858
    -0.030049317
    -0.025394516
    -0.028627016
    0.010020749
    -0.005970427
    -0.016808998
    -0.019834617
    -0.009012208
    0.0062225615
    0.005139674
    -0.016808998
    0.008747144
    -0.014908288
    -0.030747537
    -0.005918707
    0.017248617
    -0.014649688
    -0.012192989
    -0.028109817
    0.0048099593
    -0.013899748
    0.012852418
    0.021812906
    -0.008941093
    -0.006251654
    -2.5274107E-4
    -0.019925127
    -0.015166888
    -0.0051558367
    -0.015645297
    -0.029480396
    -0.007770929
    -0.010641389
    -0.0110874735
    0.025071267
    -0.017649448
    0.027334016
    -0.006665414
    0.004030927
    -0.0042022495
    -0.013654078
    -0.011171519
    -0.035764374
    -0.025355726
    0.004502872
    0.033566274
    0.009762148
    0.0111133335
    0.014248858
    -0.037315976
    0.021955136
    0.0027912634
    0.009180299
    -0.0096910335
    0.0025779183
    0.003494332
    0.008798864
    0.015942687
    0.001721306
    -0.012341684
    0.020649208
    0.030747537
    0.021735327
    0.006801179
    -0.0032906844
    -0.0024502347
    -7.976193E-4
    0.050426994
    -0.0030692583
    0.027308157
    0.005123512
    0.020804368
    0.006109424
    -0.019045888
    0.009606989
    -0.008333384
    0.020843158
    0.004127902
    -0.0022223433
    -0.0012752211
    2.2223435E-4
    0.004667729
    0.009891449
    0.021567237
    0.012024898
    -0.013039903
    0.007480004
    6.897346E-4
    0.022562847
    -0.006930479
    -0.023804126
    0.027023695
    -0.0032955334
    0.005336857
    9.3984924E-4
    -0.0015386698
    2.6486293E-4
    0.021580167
    -0.025407447
    0.005191394
    0.021179337
    6.650868E-4
    9.4631425E-4
    0.012412799
    -0.019498438
    0.043884415
    -0.011669324
    0.014714338
    0.020028567
    0.030230336
    0.0060964944
    0.017028807
    0.014494528
    -0.041091535
    -0.006283979
    -0.010887058
    -0.007505864
    0.020972457
    0.014171278
    0.004800262
    0.029480396
    0.035531636
    0.011333143
    0.010680178
    -0.0055502015
    0.008630774
    0.008087714
    -0.016899507
    0.014675548
    -0.0042410395
    -0.0028623783
    0.001882931
    -0.0025035709
    4.85279E-4
    -0.012658468
    -0.009380714
    -0.004625707
    0.0036591894
    0.016821928
    -0.014145418
    -0.010007818
    -0.021812906
    -0.0049845143
    -0.020183727
    0.018942447
    -0.0033294745
    0.007783859
    0.012904138
    0.007602839
    0.0051687667
    0.039488215
    -0.014688478
    0.016705558
    -0.002272447
    0.0049037016
    0.0010788467
    0.007654559
    -5.798296E-4
    -0.011798623
    0.030980276
    -0.015800457
    -0.014649688
    -0.022084437
    -0.017571868
    -0.018903658
    0.026894396
    0.013964398
    -0.007447679
    0.0014287648
    0.027954657
    0.019976847
    -0.030023456
    -0.008598449
    0.012936464
    0.0132079935
    -0.008184689
    0.002102741
    0.017804608
    0.010731898
    0.032583594
    0.0110874735
    -0.020830227
    -0.019032957
    -0.031342316
    0.0021690072
    0.039617516
    0.021334497
    -0.016265938
    -4.9457245E-4
    0.009464758
    -0.0041182046
    0.0058540567
    0.0038628369
    0.025497956
    -3.0345088E-4
    0.013744588
    -0.008359244
    0.030101037
    0.014649688
    -0.017908048
    -0.0041311346
    -0.029842436
    -0.023829987
    0.016149567
    0.0022546684
    -0.0123610785
    0.0028947033
    0.025562607
    0.047401372
    6.392268E-4
    0.026170317
    0.008288129
    0.030618235
    0.040315736
    0.003688282
    0.002096276
    -0.009671639
    -0.005915474
    -0.004380037
    0.0024890245
    0.013873888
    -0.005459692
    -0.013511848
    -0.0060738665
    0.0077127437
    0.007473539
    0.020054428
    2.9355136E-4
    -0.007130894
    6.6751114E-4
    -0.014998798
    -3.145626E-4
    -0.007790324
    0.013460129
    -0.009244949
    0.010958173
    -0.016860718
    -0.009303134
    -0.017041737
    0.023623107
    -0.021618957
    -0.013156273
    -0.0020429397
    -0.0038078844
    -0.045642894
    0.0049133995
    -0.011501233
    0.042306956
    -3.2405808E-4
    -0.0015103854
    -0.005766779
    -0.028161537
    -0.015761668
    -0.018645057
    -0.012257638
    -5.035628E-5
    -1.7162552E-4
    0.007783859
    0.022536987
    0.022575777
    0.023519667
    -3.6123183E-4
    -0.008624309
    0.005110582
    0.0035040295
    0.0043638744
    -0.0085919835
    -0.024735086
    -0.025821207
    -0.040962234
    0.031807795
    0.021114687
    -0.013356688
    0.0013091624
    -0.015141028
    -0.025950506
    -0.0120119685
    0.016550398
    -0.004412362
    -0.004050322
    -0.016692627
    0.020106148
    -0.024825597
    0.0019588948
    -0.017377917
    0.012774838
    9.236867E-4
    0.0045513595
    -0.011552953
    0.022407686
    0.0024760948
    0.004703287
    0.002063951
    -0.024941966
    0.009270809
    0.018192507
    0.020468187
    0.016175428
    0.004360642
    -0.0063001416
    0.024515277
    0.020636277
    -0.013809238
    0.0029431907
    -0.006271049
    -0.0040147644
    -0.026661657
    0.025342796
    -0.0058281966
    -0.027463317
    0.023868777
    -0.007512329
    -0.012212384
    -0.032738756
    -0.003830512
    0.018657988
    0.0054564592
    0.014119558
    -0.024566997
    -0.031213015
    -0.016498677
    -0.0022288084
    0.0064359065
    -0.0014029049
    -0.009904379
    -0.007990739
    0.020791437
    0.002737927
    -0.005605154
    -0.031523336
    -0.021851696
    0.007428284
    0.026816817
    0.012393403
    2.660751E-4
    0.005123512
    -0.009846194
    -0.013421338
    -0.0011087473
    0.004528732
    -0.013977328
    -0.0049295616
    0.011759833
    0.039255474
    -0.010680178
    0.017222758
    0.007842044
    0.040212296
    0.014235928
    -0.028756317
    8.9459424E-4
    -0.0025068035
    -0.013964398
    -0.024838526
    0.027308157
    -0.002453467
    0.038402095
    -0.0065328814
    0.013770448
    0.019007098
    0.028782176
    -0.002057486
    -0.029118355
    -0.014158348
    -0.009160903
    0.016615048
    -0.013240318
    -0.013938538
    0.028937336
    -0.002097892
    -0.028161537
    0.024256676
    -0.008676029
    -0.012542098
    -0.007415354
    0.008740678
    -0.009257879
    0.005314229
    -1.2191322E-5
    0.020132007
    -0.022355966
    -0.011940854
    0.006587834
    0.0050653266
    -0.008714818
    -0.019860478
    -0.013537708
    0.003240581
    -0.032428436
    0.0045901495
    0.0017261547
    -0.020364746
    -0.0034652394
    0.015903898
    0.0018344435
    -0.0060738665
    -0.0047517745
    -0.036514316
    -0.031419896
    -0.009322529
    0.012212384
    0.008831189
    0.015347908
    -0.017623588
    -0.012917068
    -6.190237E-4
    0.015076378
    0.041065674
    -0.009710428
    0.016847787
    0.004816424
    -0.001566146
    -0.011669324
    0.0036947469
    0.0050879545
    0.013201528
    0.030825116
    -0.009374249
    0.0082687335
    -0.031161295
    0.010537948
    0.033747297
    -0.013395478
    -0.031807795
    0.023817057
    0.009425969
    0.005433832
    -0.007673954
    -0.011488304
    -0.015528928
    0.006322769
    -5.7094026E-4
    0.0020671834
    -0.0011241017
    -0.036488455
    -0.05156483
    0.023118837
    -0.0042604343
    0.026183246
    -0.007518794
    -0.017714098
    -0.0013907829
    0.0020413236
    -0.035066154
    0.005501714
    0.015283258
    -0.008876444
    -0.006936944
    0.006303374
    -3.986076E-4
    -0.009800939
    -0.037005655
    -0.005055629
    0.003216337
    0.030411355
    -0.021851696
    -0.010305208
    -0.0040955767
    0.021334497
    -0.008120039
    0.0031743145
    -0.016808998
    3.973954E-4
    -0.004489942
    -0.016563328
    0.017649448
    -0.0028688433
    -0.026415987
    0.0023063885
    -4.0264823E-4
    -0.004544894
    -0.05466803
    -0.031445757
    9.2126237E-4
    -0.009884983
    -0.026377195
    0.012697258
    0.0026296384
    0.011921458
    0.019601878
    -0.007906694
    -0.012548563
    0.009005744
    0.006820574
    0.024385978
    6.5902586E-4
    0.0021189034
    -0.024243746
    -0.0020203122
    -0.013039903
    -0.025976367
    0.019291557
    -0.019304488
    -0.031316455
    -0.0055889916
    -0.008430359
    0.018787287
    -0.016369378
    -0.019938057
    0.021683607
    -0.010182373
    0.003487867
    -0.009283739
    -0.008527334
    0.011766299
    -0.006872294
    0.003403822
    0.012173593
    -2.0304137E-4
    -0.025549676
    -0.032531876
    -0.0024550834
    0.002367806
    -0.037419416
    -0.021011246
    -0.020739717
    0.046858314
    -0.019537227
    0.024217887
    -0.022019787
    -0.016964158
    -0.034238636
    0.023623107
    -0.0068787592
    -0.031497475
    0.0010780386
    0.038531393
    0.034652397
    0.016472818
    0.0091673685
    -0.014339368
    -0.0134084085
    -0.030695817
    -0.035117876
    -0.009949634
    0.0060867965
    0.043858554
    0.011152123
    -0.017778747
    -0.008650169
    -0.023312787
    -0.031885374
    -0.012283498
    0.014222998
    0.017830467
    -0.021024177
    0.025355726
    0.008410964
    0.014740198
    -0.0060415417
    0.007939019
    -0.037109096
    0.011740439
    0.036514316
    0.011843879
    -0.010007818
    -0.0063550943
    -0.036203995
    -0.023661897
    -0.006827039
    -0.008915233
    -0.013589428
    0.026765097
    0.027385736
    0.028032236
    -0.027178856
    0.038065914
    0.021593098
    -0.0044996394
    0.012063689
    0.0039565796
    -0.023804126
    -0.034781694
    0.025782416
    -0.021812906
    -4.8043026E-4
    -0.0027815658
    0.011035753
    0.0120119685
    -0.008902304
    -0.022575777
    0.016382307
    -0.024321327
    0.013317898
    -0.019498438
    -0.010104794
    0.014184208
    0.0058443593
    -0.004344479
    -0.011061613
    0.0033876596
    -0.020222517
    -0.005795872
    0.020998318
    -0.010660783
    -0.008760074
    -0.004160227
    0.015141028
    -0.020869017
    0.015231538
    8.2024676E-4
    -0.031730216
    -0.035273034
    0.052935414
    0.010576739
    -0.0016808998
    -0.008223479
    0.027178856
    0.0063647917
    0.0082428735
    -0.025459167
    -0.0041182046
    -0.018011488
    0.015257398
    0.008132969
    -0.037962474
    -0.015968548
    0.0027654034
    -0.010654318
    -0.033255957
    -0.0056407116
    0.17688237
    -0.019407928
    0.026209107
    0.038117636
    0.0044091293
    0.003539587
    0.015580648
    0.006872294
    0.0154772075
    -0.010576739
    -0.018619196
    -0.0062419567
    -0.027334016
    0.0042959917
    0.038453814
    -0.011236168
    -0.023778267
    -0.023868777
    0.007214939
    0.0035040295
    -0.0040276945
    -0.024282537
    -0.016434027
    -0.0012639073
    0.017636517
    -0.006794714
    -0.024321327
    -0.0043250844
    0.003371497
    -1.9879872E-4
    0.007124429
    -0.042436253
    -0.009044534
    0.011818019
    -0.0014231079
    -0.015890967
    0.005954264
    0.008061854
    0.016692627
    0.019782897
    0.012180058
    0.016783137
    0.002957737
    0.0039953697
    -0.018037347
    0.038143493
    0.002219111
    -0.025265217
    -0.010751293
    -0.0028833896
    -0.032506015
    0.0132079935
    0.032893915
    0.024799736
    -0.018890727
    0.015347908
    -0.013111019
    0.002432456
    -0.013667008
    0.036669474
    -0.010537948
    0.029040776
    -0.021618957
    0.030902695
    -0.015774598
    0.0044414545
    -0.024618717
    0.028833896
    0.013001113
    -0.009232019
    -0.027411597
    -0.025433306
    -0.007648094
    0.003998602
    -0.012820093
    -0.023131767
    -0.0046289396
    1.3697716E-4
    0.010182373
    0.015386698
    0.014688478
    -0.031109575
    -0.025730696
    -0.0058863815
    -0.034212776
    -0.008087714
    0.036747053
    0.018464038
    0.022226667
    -0.041453574
    2.3375012E-4
    -0.024605786
    0.014494528
    0.009678104
    -0.0060835644
    0.035686795
    -0.024954896
    0.007622234
    -0.021463796
    -0.012451588
    -0.005000677
    -0.014804848
    0.025342796
    0.012102478
    -0.026325475
    -0.022084437
    -0.016382307
    0.020183727
    0.010770689
    -0.027411597
    -0.0025035709
    3.0345088E-4
    0.017882187
    -0.014391088
    0.018464038
    -0.012108943
    -0.015839247
    -0.015386698
    7.357977E-4
    -0.027463317
    0.007790324
    -0.024489416
    0.0022288084
    0.012257638
    -0.032635316
    -0.0012913835
    0.0064746966
    0.019330347
    0.008928164
    -0.023480877
    0.014029048
    -0.029118355
    -0.0059251715
    3.830512E-4
    -0.0054273666
    0.0032308833
    -0.018916588
    -0.013537708
    -0.0089928135
    -0.008359244
    -0.018968306
    -0.010479763
    0.016240077
    -0.0032535107
    0.015244468
    0.0020558697
    0.007460609
    0.013369618
    -0.001992836
    0.009594059
    0.0027346946
    -0.019666526
    -0.011818019
    -0.029920015
    -0.0041343668
    0.0060706344
    0.0036462594
    -0.011649928
    0.018037347
    -0.0128847435
    -0.021838767
    -0.007835579
    0.015231538
    -0.017727027
    0.0051849294
    -0.012063689
    -0.16146982
    0.035350613
    0.038195215
    -0.010279348
    0.018851938
    -0.016485747
    0.024179097
    0.013977328
    -0.0044867094
    -0.0051687667
    0.019989777
    -0.0055178767
    -0.0049974443
    -0.05425427
    0.009477689
    -0.017662378
    0.0014101779
    0.041143253
    0.042513832
    0.013421338
    0.003533122
    -0.010932313
    0.027721915
    -0.017662378
    0.003804652
    0.017623588
    -0.011300818
    -9.19242E-6
    0.003500797
    0.003494332
    -0.004864912
    -0.003849907
    -0.002122136
    -0.015890967
    -0.0032842197
    -0.009522944
    0.0036397944
    -0.025653116
    -0.005430599
    -0.0010190455
    0.011391329
    0.017610658
    -0.0051558367
    0.015464278
    0.013356688
    0.029687276
    0.012470983
    -0.014326438
    0.0019508135
    -0.005188162
    0.014145418
    -7.2327175E-4
    0.039203756
    0.021321567
    -0.015658228
    9.018674E-4
    -0.0037755594
    0.012606748
    -2.3375012E-4
    -0.019071747
    0.014145418
    -6.982199E-4
    0.014546248
    -0.009833263
    -4.127498E-4
    -0.012897673
    -0.012690793
    0.0014093698
    -0.018994167
    0.0091415085
    -0.033695575
    -0.025278147
    0.025950506
    -0.017054668
    0.015166888
    0.019394998
    0.0048455168
    -0.018580407
    0.0052883695
    0.0040988093
    -0.036824636
    0.034755833
    -0.014662618
    0.007842044
    -0.006982199
    -0.016757278
    -0.004800262
    0.002615092
    -0.019692387
    -0.024799736
    0.030773396
    -0.024179097
    0.006051239
    -0.022963677
    0.0018021185
    0.021024177
    0.010718969
    -0.018489897
    0.008986348
    -8.808561E-4
    0.0058152666
    0.010137118
    -0.047065195
    0.014132488
    0.057409193
    0.012567958
    0.017856328
    0.002005766
    0.048487492
    -9.980343E-4
    0.0032648246
    -0.0027476246
    0.0051687667
    0.044660214
    0.0016728186
    0.030075176
    -0.0022562847
    -0.017533077
    0.017533077
    -0.026015157
    0.034083474
    0.008863513
    -0.030566515
    0.017533077
    0.006839969
    0.004735612
    -0.1151287
    -0.007932554
    0.002628022
    0.028368415
    0.007874369
    -0.0033941246
    0.004664497
    0.026532356
    0.031730216
    0.032350857
    -0.05086661
    -0.025510887
    0.012399868
    -0.003247046
    0.026079806
    0.006122354
    -0.012044293
    0.007518794
    0.010803013
    0.015528928
    -0.004438222
    -0.007803254
    -0.013014043
    -0.010796549
    4.4568087E-4
    1.9293981E-4
    -0.031031996
    0.011061613
    0.014882428
    0.011914994
    0.012781303
    -0.017183967
    0.0025730697
    -0.008811794
    -0.014843638
    -0.006452069
    -0.014235928
    0.005663339
    -0.012212384
    -0.021425007
    -0.008501474
    2.2364856E-4
    0.015709948
    -0.017416708
    0.034367934
    -0.016033199
    -0.040626053
    0.0024437697
    -0.034859274
    -0.029661415
    -0.020726787
    -0.010880593
    9.851042E-4
    -0.021567237
    -0.0032793707
    -0.021334497
    0.019317416
    -0.010130653
    0.0049004694
    -0.006872294
    0.011940854
    0.017002948
    -0.014261788
    0.022187877
    0.040703636
    0.012677863
    0.0011855192
    -0.008158829
    0.012761909
    -0.019601878
    0.003339172
    -0.012451588
    0.007990739
    0.010628458
    -0.022614567
    0.0051170466
    -0.045306712
    -0.0037044445
    -0.014572108
    -0.012005503
    0.0078937635
    0.0023047721
    -0.0075511187
    0.011158588
    0.0049812817
    0.019239837
    0.0063389316
    -0.006846434
    0.015800457
    -0.044763654
    0.013576498
    0.020351818
    0.0010853118
    0.010641389
    -0.010796549
    0.019045888
    0.019886337
    0.016304728
    0.013149808
    -0.010402184
    -0.038531393
    0.009510013
    -0.048487492
    0.044039574
    0.015050518
    0.0029270283
    0.019304488
    0.013485988
    0.010854733
    0.020093217
    -0.0028462159
    0.0028316695
    0.007266659
    -0.006009217
    -0.022174947
    -0.016408168
    -0.017481357
    -0.023623107
    0.027152997
    0.013667008
    0.017119318
    0.024786806
    4.549743E-4
    0.029376956
    0.022304246
    0.012419263
    -0.020313026
    -0.014416948
    -0.008566123
    0.017196897
    -0.004826122
    -0.0036010046
    0.016589187
    -0.021903416
    -0.006620159
    0.0053594843
    0.013136879
    0.0050944192
    5.8993115E-4
    0.0016526154
    0.014688478
    -0.0024809435
    -9.543955E-4
    -0.035324756
    -0.018231297
    5.3376646E-4
    -0.010124189
    0.012891208
    0.005931637
    -0.019925127
    0.024321327
    -0.0012388554
    0.035790235
    0.007473539
    0.011895598
    -0.039384775
    -0.012567958
    0.009781544
    0.016563328
    -0.011999038
    -0.025239356
    -0.040496755
    0.025847066
    -0.0057118265
    0.021386217
    -7.5357646E-5
    -0.021774117
    -0.021231057
    -0.0030013758
    0.005462924
    0.0059898216
    -0.022149086
    0.015619438
    -0.026713377
    0.008410964
    -0.011100403
    0.025135916
    0.0026506495
    -0.022045648
    0.032868054
    0.0010513705
    0.027928796
    0.014675548
    0.002750857
    -0.031057855
    0.011100403
    0.027825356
    -0.0043380144
    6.157912E-4
    0.035764374
    0.021308636
    -6.0730585E-4
    -0.031859517
    0.023959287
    -0.030385496
    -0.005782942
    0.012354613
    0.012192989
    -0.009322529
    -0.013123948
    0.019950988
    1.524073E-5
    0.007059779
    -0.0062160967
    -0.0047420766
    0.006678344
    -0.0114365835
    -0.034264494
    0.013822168
    -0.007958414
    -0.010899989
    -0.0013883585
    4.6790432E-4
    -0.012807163
    0.008676029
    0.028316695
    -0.023209346
    0.0011540024
    -0.020287167
    0.002621557
    -0.005052397
    0.029713135
    0.016640907
    4.3719556E-4
    0.009749219
    -0.006936944
    0.011397793
    0.037134957
    0.008197619
    -0.011947318
    0.014222998
    -0.010292279
    0.0032211859
    -0.0025132685
    0.0015346291
    -0.027799496
    0.013641148
    0.0048455168
    0.034083474
    0.015076378
    0.004515802
    0.06377075
    -0.024450626
    -0.0010133886
    0.010537948
    0.0020849623
    -0.0048875394
    0.0023015398
    -0.018360598
    -0.016071988
    -0.012632608
    -0.0033019984
    0.013136879
    -0.013744588
    -5.149271E-5
    -0.032454297
    0.024993686
    0.002872076
    8.509555E-4
    -0.012445123
    0.0026587308
    0.026558217
    -0.0025601396
    0.041815612
    -4.8770336E-4
    -0.013796308
    -2.6769136E-4
    0.018903658
    3.008245E-4
    0.007842044
    -0.035919536
    0.009943169
    0.024812667
    -0.043315493
    -0.010790084
    0.0032971494
    0.004050322
    0.014546248
    0.009374249
    0.0014748279
    0.011177983
    -0.007408889
    0.021670677
    -0.0123610785
    -0.009988423
    -0.0040341592
    0.004276597
    -0.022317177
    -0.026920257
    -0.017171038]}],
 :model "text-embedding-ada-002-v2",
 :usage {:prompt_tokens 124, :total_tokens 124}}

embeddings (cont.)

(defn ->embedding-vector [text]
  (-> {:model "text-embedding-ada-002"
       :input text}
      create-embedding
      :data
      first
      :embedding))
(-> a-wikipedia-paragraph-about-bananas
    ->embedding-vector)
[-2.0334442E-4
 -0.018748498
 0.028601157
 5.390193E-4
 0.025097126
 -0.005349787
 -0.013731658
 0.009063928
 -0.021787047
 -0.023416227
 -0.002776717
 0.014235928
 -0.046185955
 -0.010751293
 -0.008566123
 0.027877076
 0.027877076
 -0.008805329
 -0.014442808
 -0.027204717
 -0.003112897
 -0.013046368
 -0.017106388
 0.024489416
 -0.002283761
 0.010828873
 0.032635316
 -0.019795828
 0.029738996
 -0.003287452
 0.009277274
 0.0044317567
 -0.018295947
 -3.5820136E-4
 -0.014740198
 0.005782942
 0.001954046
 0.0053465543
 -0.015709948
 -0.010395719
 0.018774357
 0.017390847
 -0.002063951
 -0.0016380692
 -0.029816575
 0.0049004694
 -0.0020300096
 -0.016408168
 -0.025200566
 0.020183727
 0.023299856
 0.026403056
 -0.018476967
 0.005201092
 -0.023455016
 -0.016938297
 -0.0034329146
 7.705471E-4
 4.7840993E-4
 -0.0058152666
 -0.009206159
 0.021877557
 -0.008688958
 -0.014029048
 -0.015865108
 -5.2002835E-4
 0.0052495794
 -0.021877557
 -0.007454144
 0.009826799
 -0.0014004804
 0.019873407
 -0.012354613
 0.0063809543
 0.015878038
 0.001773026
 -0.009587593
 0.0031161297
 -0.038453814
 -0.0040406245
 0.026170317
 -0.011514164
 -0.0065425793
 0.035376474
 -0.0013091624
 0.016925368
 -0.0044576167
 0.021799978
 0.0014214917
 -0.020106148
 -0.006697739
 0.005527574
 -0.003474937
 0.0011798623
 0.0060059843
 5.147756E-4
 -0.021864627
 0.012264104
 0.006917549
 -0.041582875
 -0.010977568
 0.0054144366
 -0.021722397
 -0.012257638
 -0.035092015
 0.006471464
 0.036591895
 -0.011805088
 0.007208474
 -0.042539693
 -0.012652003
 0.024967827
 -0.014727268
 -0.027825356
 -0.012496843
 -0.0082687335
 0.026506497
 0.019291557
 0.014404018
 -0.018800218
 0.031006135
 -0.0014271486
 0.023674827
 -0.003636562
 0.014248858
 0.010066004
 0.003397357
 -0.032661177
 -0.015218608
 -0.0048358194
 0.035428196
 -0.0016404935
 -0.012205918
 0.014248858
 8.012558E-4
 0.008766538
 -0.0037496996
 -0.006865829
 0.0034587744
 -0.018451108
 0.0128847435
 0.014222998
 -0.020338887
 -0.012593818
 -0.029480396
 0.018994167
 0.020778507
 0.044143014
 -4.8366273E-4
 -0.025769487
 0.011882668
 0.0047679367
 0.037548713
 -0.0038789995
 0.011145659
 0.0020413236
 -0.003227651
 0.010162978
 -0.0016291798
 0.008934629
 -0.0050200718
 0.005999519
 -0.013589428
 0.0034005896
 -0.003649492
 0.041738033
 -0.0041052746
 -0.012192989
 0.011501233
 -0.0100401435
 0.009917309
 0.026351336
 -0.007945484
 9.96418E-4
 0.026338406
 0.003727072
 2.8445997E-4
 -0.019976847
 -0.016304728
 -0.0016905973
 -0.016951228
 -0.0036785845
 -0.0012445123
 0.010964639
 -0.027825356
 -0.014740198
 0.014585038
 -0.015813388
 0.020636277
 -0.008100644
 -9.762149E-4
 0.002576302
 0.010492694
 0.004367107
 -0.6537407
 0.014378158
 0.017028807
 -0.011139194
 0.034057613
 0.019537227
 0.006930479
 0.0018360597
 -0.018709708
 -0.003326242
 -0.004864912
 -0.002542361
 0.015141028
 0.002440537
 -0.014985868
 -0.024347186
 -0.004599847
 -0.032014675
 -0.013511848
 0.0020623347
 -0.035712656
 0.024683367
 -0.009251414
 -0.0027734847
 -0.005042699
 -0.011669324
 0.018981237
 -0.0022304247
 -0.001624331
 0.020907806
 -0.005472622
 -7.458993E-4
 0.022575777
 0.040962234
 0.033824876
 0.0053206943
 -0.028575296
 0.008365708
 -0.0039695096
 0.022847306
 -0.010453903
 -0.009788008
 0.024941966
 -0.030204475
 -0.018451108
 8.638855E-4
 0.035609215
 -0.0041569946
 0.005595457
 -0.010906453
 0.004722682
 -0.008275199
 -5.2629133E-5
 -0.031031996
 -0.019692387
 0.015735807
 0.040470894
 0.0026538821
 -0.005430599
 -0.021851696
 -0.024618717
 -0.0060577043
 -0.028885616
 -0.0109387785
 -7.70143E-4
 0.021980997
 -0.010725434
 0.024941966
 0.024204956
 -0.012264104
 0.015412558
 0.004851982
 -0.003436147
 -0.0023564922
 0.020907806
 0.0018360597
 0.024230817
 -0.009548804
 -0.009529409
 0.011455978
 0.0026926722
 0.018360598
 0.018192507
 -0.004244272
 0.031264737
 0.0057085943
 -0.0030401659
 0.014804848
 0.0015136179
 -0.010492694
 0.014404018
 -0.0014020967
 0.006917549
 -0.008107109
 -0.0028882383
 0.011649928
 -0.038402095
 -0.013104553
 -0.028161537
 0.019692387
 -0.016899507
 -0.020662136
 -0.016214218
 -0.0013511848
 0.032143977
 0.008915233
 -0.051538974
 0.017856328
 0.043418933
 -0.026015157
 -0.017558938
 -0.0037884894
 -0.014817778
 0.003242197
 0.013576498
 -0.020338887
 -0.004884307
 0.004341247
 0.008986348
 -0.006613694
 0.036229856
 0.018425247
 0.015839247
 -0.010311673
 0.010137118
 0.0043961992
 0.0037044445
 -0.022743868
 -0.009025139
 -0.031394035
 0.003099967
 -0.009180299
 -0.0026571145
 -0.008404499
 0.034419656
 0.014429878
 -6.161952E-4
 -0.007408889
 0.012955858
 -0.030049317
 -0.025394516
 -0.028627016
 0.010020749
 -0.005970427
 -0.016808998
 -0.019834617
 -0.009012208
 0.0062225615
 0.005139674
 -0.016808998
 0.008747144
 -0.014908288
 -0.030747537
 -0.005918707
 0.017248617
 -0.014649688
 -0.012192989
 -0.028109817
 0.0048099593
 -0.013899748
 0.012852418
 0.021812906
 -0.008941093
 -0.006251654
 -2.5274107E-4
 -0.019925127
 -0.015166888
 -0.0051558367
 -0.015645297
 -0.029480396
 -0.007770929
 -0.010641389
 -0.0110874735
 0.025071267
 -0.017649448
 0.027334016
 -0.006665414
 0.004030927
 -0.0042022495
 -0.013654078
 -0.011171519
 -0.035764374
 -0.025355726
 0.004502872
 0.033566274
 0.009762148
 0.0111133335
 0.014248858
 -0.037315976
 0.021955136
 0.0027912634
 0.009180299
 -0.0096910335
 0.0025779183
 0.003494332
 0.008798864
 0.015942687
 0.001721306
 -0.012341684
 0.020649208
 0.030747537
 0.021735327
 0.006801179
 -0.0032906844
 -0.0024502347
 -7.976193E-4
 0.050426994
 -0.0030692583
 0.027308157
 0.005123512
 0.020804368
 0.006109424
 -0.019045888
 0.009606989
 -0.008333384
 0.020843158
 0.004127902
 -0.0022223433
 -0.0012752211
 2.2223435E-4
 0.004667729
 0.009891449
 0.021567237
 0.012024898
 -0.013039903
 0.007480004
 6.897346E-4
 0.022562847
 -0.006930479
 -0.023804126
 0.027023695
 -0.0032955334
 0.005336857
 9.3984924E-4
 -0.0015386698
 2.6486293E-4
 0.021580167
 -0.025407447
 0.005191394
 0.021179337
 6.650868E-4
 9.4631425E-4
 0.012412799
 -0.019498438
 0.043884415
 -0.011669324
 0.014714338
 0.020028567
 0.030230336
 0.0060964944
 0.017028807
 0.014494528
 -0.041091535
 -0.006283979
 -0.010887058
 -0.007505864
 0.020972457
 0.014171278
 0.004800262
 0.029480396
 0.035531636
 0.011333143
 0.010680178
 -0.0055502015
 0.008630774
 0.008087714
 -0.016899507
 0.014675548
 -0.0042410395
 -0.0028623783
 0.001882931
 -0.0025035709
 4.85279E-4
 -0.012658468
 -0.009380714
 -0.004625707
 0.0036591894
 0.016821928
 -0.014145418
 -0.010007818
 -0.021812906
 -0.0049845143
 -0.020183727
 0.018942447
 -0.0033294745
 0.007783859
 0.012904138
 0.007602839
 0.0051687667
 0.039488215
 -0.014688478
 0.016705558
 -0.002272447
 0.0049037016
 0.0010788467
 0.007654559
 -5.798296E-4
 -0.011798623
 0.030980276
 -0.015800457
 -0.014649688
 -0.022084437
 -0.017571868
 -0.018903658
 0.026894396
 0.013964398
 -0.007447679
 0.0014287648
 0.027954657
 0.019976847
 -0.030023456
 -0.008598449
 0.012936464
 0.0132079935
 -0.008184689
 0.002102741
 0.017804608
 0.010731898
 0.032583594
 0.0110874735
 -0.020830227
 -0.019032957
 -0.031342316
 0.0021690072
 0.039617516
 0.021334497
 -0.016265938
 -4.9457245E-4
 0.009464758
 -0.0041182046
 0.0058540567
 0.0038628369
 0.025497956
 -3.0345088E-4
 0.013744588
 -0.008359244
 0.030101037
 0.014649688
 -0.017908048
 -0.0041311346
 -0.029842436
 -0.023829987
 0.016149567
 0.0022546684
 -0.0123610785
 0.0028947033
 0.025562607
 0.047401372
 6.392268E-4
 0.026170317
 0.008288129
 0.030618235
 0.040315736
 0.003688282
 0.002096276
 -0.009671639
 -0.005915474
 -0.004380037
 0.0024890245
 0.013873888
 -0.005459692
 -0.013511848
 -0.0060738665
 0.0077127437
 0.007473539
 0.020054428
 2.9355136E-4
 -0.007130894
 6.6751114E-4
 -0.014998798
 -3.145626E-4
 -0.007790324
 0.013460129
 -0.009244949
 0.010958173
 -0.016860718
 -0.009303134
 -0.017041737
 0.023623107
 -0.021618957
 -0.013156273
 -0.0020429397
 -0.0038078844
 -0.045642894
 0.0049133995
 -0.011501233
 0.042306956
 -3.2405808E-4
 -0.0015103854
 -0.005766779
 -0.028161537
 -0.015761668
 -0.018645057
 -0.012257638
 -5.035628E-5
 -1.7162552E-4
 0.007783859
 0.022536987
 0.022575777
 0.023519667
 -3.6123183E-4
 -0.008624309
 0.005110582
 0.0035040295
 0.0043638744
 -0.0085919835
 -0.024735086
 -0.025821207
 -0.040962234
 0.031807795
 0.021114687
 -0.013356688
 0.0013091624
 -0.015141028
 -0.025950506
 -0.0120119685
 0.016550398
 -0.004412362
 -0.004050322
 -0.016692627
 0.020106148
 -0.024825597
 0.0019588948
 -0.017377917
 0.012774838
 9.236867E-4
 0.0045513595
 -0.011552953
 0.022407686
 0.0024760948
 0.004703287
 0.002063951
 -0.024941966
 0.009270809
 0.018192507
 0.020468187
 0.016175428
 0.004360642
 -0.0063001416
 0.024515277
 0.020636277
 -0.013809238
 0.0029431907
 -0.006271049
 -0.0040147644
 -0.026661657
 0.025342796
 -0.0058281966
 -0.027463317
 0.023868777
 -0.007512329
 -0.012212384
 -0.032738756
 -0.003830512
 0.018657988
 0.0054564592
 0.014119558
 -0.024566997
 -0.031213015
 -0.016498677
 -0.0022288084
 0.0064359065
 -0.0014029049
 -0.009904379
 -0.007990739
 0.020791437
 0.002737927
 -0.005605154
 -0.031523336
 -0.021851696
 0.007428284
 0.026816817
 0.012393403
 2.660751E-4
 0.005123512
 -0.009846194
 -0.013421338
 -0.0011087473
 0.004528732
 -0.013977328
 -0.0049295616
 0.011759833
 0.039255474
 -0.010680178
 0.017222758
 0.007842044
 0.040212296
 0.014235928
 -0.028756317
 8.9459424E-4
 -0.0025068035
 -0.013964398
 -0.024838526
 0.027308157
 -0.002453467
 0.038402095
 -0.0065328814
 0.013770448
 0.019007098
 0.028782176
 -0.002057486
 -0.029118355
 -0.014158348
 -0.009160903
 0.016615048
 -0.013240318
 -0.013938538
 0.028937336
 -0.002097892
 -0.028161537
 0.024256676
 -0.008676029
 -0.012542098
 -0.007415354
 0.008740678
 -0.009257879
 0.005314229
 -1.2191322E-5
 0.020132007
 -0.022355966
 -0.011940854
 0.006587834
 0.0050653266
 -0.008714818
 -0.019860478
 -0.013537708
 0.003240581
 -0.032428436
 0.0045901495
 0.0017261547
 -0.020364746
 -0.0034652394
 0.015903898
 0.0018344435
 -0.0060738665
 -0.0047517745
 -0.036514316
 -0.031419896
 -0.009322529
 0.012212384
 0.008831189
 0.015347908
 -0.017623588
 -0.012917068
 -6.190237E-4
 0.015076378
 0.041065674
 -0.009710428
 0.016847787
 0.004816424
 -0.001566146
 -0.011669324
 0.0036947469
 0.0050879545
 0.013201528
 0.030825116
 -0.009374249
 0.0082687335
 -0.031161295
 0.010537948
 0.033747297
 -0.013395478
 -0.031807795
 0.023817057
 0.009425969
 0.005433832
 -0.007673954
 -0.011488304
 -0.015528928
 0.006322769
 -5.7094026E-4
 0.0020671834
 -0.0011241017
 -0.036488455
 -0.05156483
 0.023118837
 -0.0042604343
 0.026183246
 -0.007518794
 -0.017714098
 -0.0013907829
 0.0020413236
 -0.035066154
 0.005501714
 0.015283258
 -0.008876444
 -0.006936944
 0.006303374
 -3.986076E-4
 -0.009800939
 -0.037005655
 -0.005055629
 0.003216337
 0.030411355
 -0.021851696
 -0.010305208
 -0.0040955767
 0.021334497
 -0.008120039
 0.0031743145
 -0.016808998
 3.973954E-4
 -0.004489942
 -0.016563328
 0.017649448
 -0.0028688433
 -0.026415987
 0.0023063885
 -4.0264823E-4
 -0.004544894
 -0.05466803
 -0.031445757
 9.2126237E-4
 -0.009884983
 -0.026377195
 0.012697258
 0.0026296384
 0.011921458
 0.019601878
 -0.007906694
 -0.012548563
 0.009005744
 0.006820574
 0.024385978
 6.5902586E-4
 0.0021189034
 -0.024243746
 -0.0020203122
 -0.013039903
 -0.025976367
 0.019291557
 -0.019304488
 -0.031316455
 -0.0055889916
 -0.008430359
 0.018787287
 -0.016369378
 -0.019938057
 0.021683607
 -0.010182373
 0.003487867
 -0.009283739
 -0.008527334
 0.011766299
 -0.006872294
 0.003403822
 0.012173593
 -2.0304137E-4
 -0.025549676
 -0.032531876
 -0.0024550834
 0.002367806
 -0.037419416
 -0.021011246
 -0.020739717
 0.046858314
 -0.019537227
 0.024217887
 -0.022019787
 -0.016964158
 -0.034238636
 0.023623107
 -0.0068787592
 -0.031497475
 0.0010780386
 0.038531393
 0.034652397
 0.016472818
 0.0091673685
 -0.014339368
 -0.0134084085
 -0.030695817
 -0.035117876
 -0.009949634
 0.0060867965
 0.043858554
 0.011152123
 -0.017778747
 -0.008650169
 -0.023312787
 -0.031885374
 -0.012283498
 0.014222998
 0.017830467
 -0.021024177
 0.025355726
 0.008410964
 0.014740198
 -0.0060415417
 0.007939019
 -0.037109096
 0.011740439
 0.036514316
 0.011843879
 -0.010007818
 -0.0063550943
 -0.036203995
 -0.023661897
 -0.006827039
 -0.008915233
 -0.013589428
 0.026765097
 0.027385736
 0.028032236
 -0.027178856
 0.038065914
 0.021593098
 -0.0044996394
 0.012063689
 0.0039565796
 -0.023804126
 -0.034781694
 0.025782416
 -0.021812906
 -4.8043026E-4
 -0.0027815658
 0.011035753
 0.0120119685
 -0.008902304
 -0.022575777
 0.016382307
 -0.024321327
 0.013317898
 -0.019498438
 -0.010104794
 0.014184208
 0.0058443593
 -0.004344479
 -0.011061613
 0.0033876596
 -0.020222517
 -0.005795872
 0.020998318
 -0.010660783
 -0.008760074
 -0.004160227
 0.015141028
 -0.020869017
 0.015231538
 8.2024676E-4
 -0.031730216
 -0.035273034
 0.052935414
 0.010576739
 -0.0016808998
 -0.008223479
 0.027178856
 0.0063647917
 0.0082428735
 -0.025459167
 -0.0041182046
 -0.018011488
 0.015257398
 0.008132969
 -0.037962474
 -0.015968548
 0.0027654034
 -0.010654318
 -0.033255957
 -0.0056407116
 0.17688237
 -0.019407928
 0.026209107
 0.038117636
 0.0044091293
 0.003539587
 0.015580648
 0.006872294
 0.0154772075
 -0.010576739
 -0.018619196
 -0.0062419567
 -0.027334016
 0.0042959917
 0.038453814
 -0.011236168
 -0.023778267
 -0.023868777
 0.007214939
 0.0035040295
 -0.0040276945
 -0.024282537
 -0.016434027
 -0.0012639073
 0.017636517
 -0.006794714
 -0.024321327
 -0.0043250844
 0.003371497
 -1.9879872E-4
 0.007124429
 -0.042436253
 -0.009044534
 0.011818019
 -0.0014231079
 -0.015890967
 0.005954264
 0.008061854
 0.016692627
 0.019782897
 0.012180058
 0.016783137
 0.002957737
 0.0039953697
 -0.018037347
 0.038143493
 0.002219111
 -0.025265217
 -0.010751293
 -0.0028833896
 -0.032506015
 0.0132079935
 0.032893915
 0.024799736
 -0.018890727
 0.015347908
 -0.013111019
 0.002432456
 -0.013667008
 0.036669474
 -0.010537948
 0.029040776
 -0.021618957
 0.030902695
 -0.015774598
 0.0044414545
 -0.024618717
 0.028833896
 0.013001113
 -0.009232019
 -0.027411597
 -0.025433306
 -0.007648094
 0.003998602
 -0.012820093
 -0.023131767
 -0.0046289396
 1.3697716E-4
 0.010182373
 0.015386698
 0.014688478
 -0.031109575
 -0.025730696
 -0.0058863815
 -0.034212776
 -0.008087714
 0.036747053
 0.018464038
 0.022226667
 -0.041453574
 2.3375012E-4
 -0.024605786
 0.014494528
 0.009678104
 -0.0060835644
 0.035686795
 -0.024954896
 0.007622234
 -0.021463796
 -0.012451588
 -0.005000677
 -0.014804848
 0.025342796
 0.012102478
 -0.026325475
 -0.022084437
 -0.016382307
 0.020183727
 0.010770689
 -0.027411597
 -0.0025035709
 3.0345088E-4
 0.017882187
 -0.014391088
 0.018464038
 -0.012108943
 -0.015839247
 -0.015386698
 7.357977E-4
 -0.027463317
 0.007790324
 -0.024489416
 0.0022288084
 0.012257638
 -0.032635316
 -0.0012913835
 0.0064746966
 0.019330347
 0.008928164
 -0.023480877
 0.014029048
 -0.029118355
 -0.0059251715
 3.830512E-4
 -0.0054273666
 0.0032308833
 -0.018916588
 -0.013537708
 -0.0089928135
 -0.008359244
 -0.018968306
 -0.010479763
 0.016240077
 -0.0032535107
 0.015244468
 0.0020558697
 0.007460609
 0.013369618
 -0.001992836
 0.009594059
 0.0027346946
 -0.019666526
 -0.011818019
 -0.029920015
 -0.0041343668
 0.0060706344
 0.0036462594
 -0.011649928
 0.018037347
 -0.0128847435
 -0.021838767
 -0.007835579
 0.015231538
 -0.017727027
 0.0051849294
 -0.012063689
 -0.16146982
 0.035350613
 0.038195215
 -0.010279348
 0.018851938
 -0.016485747
 0.024179097
 0.013977328
 -0.0044867094
 -0.0051687667
 0.019989777
 -0.0055178767
 -0.0049974443
 -0.05425427
 0.009477689
 -0.017662378
 0.0014101779
 0.041143253
 0.042513832
 0.013421338
 0.003533122
 -0.010932313
 0.027721915
 -0.017662378
 0.003804652
 0.017623588
 -0.011300818
 -9.19242E-6
 0.003500797
 0.003494332
 -0.004864912
 -0.003849907
 -0.002122136
 -0.015890967
 -0.0032842197
 -0.009522944
 0.0036397944
 -0.025653116
 -0.005430599
 -0.0010190455
 0.011391329
 0.017610658
 -0.0051558367
 0.015464278
 0.013356688
 0.029687276
 0.012470983
 -0.014326438
 0.0019508135
 -0.005188162
 0.014145418
 -7.2327175E-4
 0.039203756
 0.021321567
 -0.015658228
 9.018674E-4
 -0.0037755594
 0.012606748
 -2.3375012E-4
 -0.019071747
 0.014145418
 -6.982199E-4
 0.014546248
 -0.009833263
 -4.127498E-4
 -0.012897673
 -0.012690793
 0.0014093698
 -0.018994167
 0.0091415085
 -0.033695575
 -0.025278147
 0.025950506
 -0.017054668
 0.015166888
 0.019394998
 0.0048455168
 -0.018580407
 0.0052883695
 0.0040988093
 -0.036824636
 0.034755833
 -0.014662618
 0.007842044
 -0.006982199
 -0.016757278
 -0.004800262
 0.002615092
 -0.019692387
 -0.024799736
 0.030773396
 -0.024179097
 0.006051239
 -0.022963677
 0.0018021185
 0.021024177
 0.010718969
 -0.018489897
 0.008986348
 -8.808561E-4
 0.0058152666
 0.010137118
 -0.047065195
 0.014132488
 0.057409193
 0.012567958
 0.017856328
 0.002005766
 0.048487492
 -9.980343E-4
 0.0032648246
 -0.0027476246
 0.0051687667
 0.044660214
 0.0016728186
 0.030075176
 -0.0022562847
 -0.017533077
 0.017533077
 -0.026015157
 0.034083474
 0.008863513
 -0.030566515
 0.017533077
 0.006839969
 0.004735612
 -0.1151287
 -0.007932554
 0.002628022
 0.028368415
 0.007874369
 -0.0033941246
 0.004664497
 0.026532356
 0.031730216
 0.032350857
 -0.05086661
 -0.025510887
 0.012399868
 -0.003247046
 0.026079806
 0.006122354
 -0.012044293
 0.007518794
 0.010803013
 0.015528928
 -0.004438222
 -0.007803254
 -0.013014043
 -0.010796549
 4.4568087E-4
 1.9293981E-4
 -0.031031996
 0.011061613
 0.014882428
 0.011914994
 0.012781303
 -0.017183967
 0.0025730697
 -0.008811794
 -0.014843638
 -0.006452069
 -0.014235928
 0.005663339
 -0.012212384
 -0.021425007
 -0.008501474
 2.2364856E-4
 0.015709948
 -0.017416708
 0.034367934
 -0.016033199
 -0.040626053
 0.0024437697
 -0.034859274
 -0.029661415
 -0.020726787
 -0.010880593
 9.851042E-4
 -0.021567237
 -0.0032793707
 -0.021334497
 0.019317416
 -0.010130653
 0.0049004694
 -0.006872294
 0.011940854
 0.017002948
 -0.014261788
 0.022187877
 0.040703636
 0.012677863
 0.0011855192
 -0.008158829
 0.012761909
 -0.019601878
 0.003339172
 -0.012451588
 0.007990739
 0.010628458
 -0.022614567
 0.0051170466
 -0.045306712
 -0.0037044445
 -0.014572108
 -0.012005503
 0.0078937635
 0.0023047721
 -0.0075511187
 0.011158588
 0.0049812817
 0.019239837
 0.0063389316
 -0.006846434
 0.015800457
 -0.044763654
 0.013576498
 0.020351818
 0.0010853118
 0.010641389
 -0.010796549
 0.019045888
 0.019886337
 0.016304728
 0.013149808
 -0.010402184
 -0.038531393
 0.009510013
 -0.048487492
 0.044039574
 0.015050518
 0.0029270283
 0.019304488
 0.013485988
 0.010854733
 0.020093217
 -0.0028462159
 0.0028316695
 0.007266659
 -0.006009217
 -0.022174947
 -0.016408168
 -0.017481357
 -0.023623107
 0.027152997
 0.013667008
 0.017119318
 0.024786806
 4.549743E-4
 0.029376956
 0.022304246
 0.012419263
 -0.020313026
 -0.014416948
 -0.008566123
 0.017196897
 -0.004826122
 -0.0036010046
 0.016589187
 -0.021903416
 -0.006620159
 0.0053594843
 0.013136879
 0.0050944192
 5.8993115E-4
 0.0016526154
 0.014688478
 -0.0024809435
 -9.543955E-4
 -0.035324756
 -0.018231297
 5.3376646E-4
 -0.010124189
 0.012891208
 0.005931637
 -0.019925127
 0.024321327
 -0.0012388554
 0.035790235
 0.007473539
 0.011895598
 -0.039384775
 -0.012567958
 0.009781544
 0.016563328
 -0.011999038
 -0.025239356
 -0.040496755
 0.025847066
 -0.0057118265
 0.021386217
 -7.5357646E-5
 -0.021774117
 -0.021231057
 -0.0030013758
 0.005462924
 0.0059898216
 -0.022149086
 0.015619438
 -0.026713377
 0.008410964
 -0.011100403
 0.025135916
 0.0026506495
 -0.022045648
 0.032868054
 0.0010513705
 0.027928796
 0.014675548
 0.002750857
 -0.031057855
 0.011100403
 0.027825356
 -0.0043380144
 6.157912E-4
 0.035764374
 0.021308636
 -6.0730585E-4
 -0.031859517
 0.023959287
 -0.030385496
 -0.005782942
 0.012354613
 0.012192989
 -0.009322529
 -0.013123948
 0.019950988
 1.524073E-5
 0.007059779
 -0.0062160967
 -0.0047420766
 0.006678344
 -0.0114365835
 -0.034264494
 0.013822168
 -0.007958414
 -0.010899989
 -0.0013883585
 4.6790432E-4
 -0.012807163
 0.008676029
 0.028316695
 -0.023209346
 0.0011540024
 -0.020287167
 0.002621557
 -0.005052397
 0.029713135
 0.016640907
 4.3719556E-4
 0.009749219
 -0.006936944
 0.011397793
 0.037134957
 0.008197619
 -0.011947318
 0.014222998
 -0.010292279
 0.0032211859
 -0.0025132685
 0.0015346291
 -0.027799496
 0.013641148
 0.0048455168
 0.034083474
 0.015076378
 0.004515802
 0.06377075
 -0.024450626
 -0.0010133886
 0.010537948
 0.0020849623
 -0.0048875394
 0.0023015398
 -0.018360598
 -0.016071988
 -0.012632608
 -0.0033019984
 0.013136879
 -0.013744588
 -5.149271E-5
 -0.032454297
 0.024993686
 0.002872076
 8.509555E-4
 -0.012445123
 0.0026587308
 0.026558217
 -0.0025601396
 0.041815612
 -4.8770336E-4
 -0.013796308
 -2.6769136E-4
 0.018903658
 3.008245E-4
 0.007842044
 -0.035919536
 0.009943169
 0.024812667
 -0.043315493
 -0.010790084
 0.0032971494
 0.004050322
 0.014546248
 0.009374249
 0.0014748279
 0.011177983
 -0.007408889
 0.021670677
 -0.0123610785
 -0.009988423
 -0.0040341592
 0.004276597
 -0.022317177
 -0.026920257
 -0.017171038]

embedding dimension

(-> a-wikipedia-paragraph-about-bananas
    ->embedding-vector
    count)
1536

Using vald-client-clj

(def embedding-dimension 1536)
(def vald-client
  (vald/vald-client "localhost" 8081))

Inserting vectors

(defn insert-vector [v id info]
  (-> vald-client
      (vald/insert {}
                   id
                   (vec v))))

Remembering vectors on our REPL

(defonce *vectors
  (atom {}))
nil
(defn remember-vector! [v id info]
  (if-let [known-case (@*vectors id)]
    (do (assert (-> known-case
                    :vector
                    (= v)))
        :ok-already-there)
    ;; else
    (do (insert-vector v id info)
        (swap! *vectors assoc id {:info info
                                  :vector v})
        :ok-just-added)))
(def my-vector
  (-> embedding-dimension range reverse vec))
(remember-vector! my-vector
                  "my-id-6"
                  {:text "hello"})
:ok-already-there

Searching for vectors

(defn search [v options]
  (-> vald-client
      (vald/search (merge {:num 1}
                          options )
                   v)))
(-> my-vector
    (search {:num 3}))
[{:id "my-id-6", :distance 0.0}
 {:id "banana-1", :distance 34738.773}
 {:id "banana-4", :distance 34738.773}]

Managing knowledge

Collecting knowledge

(-> a-wikipedia-paragraph-about-bananas
    ->embedding-vector
    (remember-vector! "banana-1" {:text a-wikipedia-paragraph-about-bananas}))
:ok-already-there

Extracting vectors

(-> a-wikipedia-paragraph-about-bananas
    ->embedding-vector
    (search {}))
[{:id "banana-1", :distance 0.0}]

Extracting the relevant knowledge

(defn extract [text]
  (-> text
      ->embedding-vector
      (search {})
      first
      :id
      (@*vectors)))
(-> a-wikipedia-paragraph-about-bananas
    extract)
{:info
 {:text
  "By wikipedia:\n The banana fruits develop from the banana heart, in a large hanging cluster, made up of tiers (called \"hands\"), with up to 20 fruit to a tier. The hanging cluster is known as a bunch, comprising 3–20 tiers, or commercially as a \"banana stem\", and can weigh 30–50 kilograms (66–110 lb). Individual banana fruits (commonly known as a banana or \"finger\") average 125 grams (4+1⁄2 oz), of which approximately 75% is water and 25% dry matter (nutrient table, lower right)."},
 :vector
 [-2.0334442E-4
  -0.018748498
  0.028601157
  5.390193E-4
  0.025097126
  -0.005349787
  -0.013731658
  0.009063928
  -0.021787047
  -0.023416227
  -0.002776717
  0.014235928
  -0.046185955
  -0.010751293
  -0.008566123
  0.027877076
  0.027877076
  -0.008805329
  -0.014442808
  -0.027204717
  -0.003112897
  -0.013046368
  -0.017106388
  0.024489416
  -0.002283761
  0.010828873
  0.032635316
  -0.019795828
  0.029738996
  -0.003287452
  0.009277274
  0.0044317567
  -0.018295947
  -3.5820136E-4
  -0.014740198
  0.005782942
  0.001954046
  0.0053465543
  -0.015709948
  -0.010395719
  0.018774357
  0.017390847
  -0.002063951
  -0.0016380692
  -0.029816575
  0.0049004694
  -0.0020300096
  -0.016408168
  -0.025200566
  0.020183727
  0.023299856
  0.026403056
  -0.018476967
  0.005201092
  -0.023455016
  -0.016938297
  -0.0034329146
  7.705471E-4
  4.7840993E-4
  -0.0058152666
  -0.009206159
  0.021877557
  -0.008688958
  -0.014029048
  -0.015865108
  -5.2002835E-4
  0.0052495794
  -0.021877557
  -0.007454144
  0.009826799
  -0.0014004804
  0.019873407
  -0.012354613
  0.0063809543
  0.015878038
  0.001773026
  -0.009587593
  0.0031161297
  -0.038453814
  -0.0040406245
  0.026170317
  -0.011514164
  -0.0065425793
  0.035376474
  -0.0013091624
  0.016925368
  -0.0044576167
  0.021799978
  0.0014214917
  -0.020106148
  -0.006697739
  0.005527574
  -0.003474937
  0.0011798623
  0.0060059843
  5.147756E-4
  -0.021864627
  0.012264104
  0.006917549
  -0.041582875
  -0.010977568
  0.0054144366
  -0.021722397
  -0.012257638
  -0.035092015
  0.006471464
  0.036591895
  -0.011805088
  0.007208474
  -0.042539693
  -0.012652003
  0.024967827
  -0.014727268
  -0.027825356
  -0.012496843
  -0.0082687335
  0.026506497
  0.019291557
  0.014404018
  -0.018800218
  0.031006135
  -0.0014271486
  0.023674827
  -0.003636562
  0.014248858
  0.010066004
  0.003397357
  -0.032661177
  -0.015218608
  -0.0048358194
  0.035428196
  -0.0016404935
  -0.012205918
  0.014248858
  8.012558E-4
  0.008766538
  -0.0037496996
  -0.006865829
  0.0034587744
  -0.018451108
  0.0128847435
  0.014222998
  -0.020338887
  -0.012593818
  -0.029480396
  0.018994167
  0.020778507
  0.044143014
  -4.8366273E-4
  -0.025769487
  0.011882668
  0.0047679367
  0.037548713
  -0.0038789995
  0.011145659
  0.0020413236
  -0.003227651
  0.010162978
  -0.0016291798
  0.008934629
  -0.0050200718
  0.005999519
  -0.013589428
  0.0034005896
  -0.003649492
  0.041738033
  -0.0041052746
  -0.012192989
  0.011501233
  -0.0100401435
  0.009917309
  0.026351336
  -0.007945484
  9.96418E-4
  0.026338406
  0.003727072
  2.8445997E-4
  -0.019976847
  -0.016304728
  -0.0016905973
  -0.016951228
  -0.0036785845
  -0.0012445123
  0.010964639
  -0.027825356
  -0.014740198
  0.014585038
  -0.015813388
  0.020636277
  -0.008100644
  -9.762149E-4
  0.002576302
  0.010492694
  0.004367107
  -0.6537407
  0.014378158
  0.017028807
  -0.011139194
  0.034057613
  0.019537227
  0.006930479
  0.0018360597
  -0.018709708
  -0.003326242
  -0.004864912
  -0.002542361
  0.015141028
  0.002440537
  -0.014985868
  -0.024347186
  -0.004599847
  -0.032014675
  -0.013511848
  0.0020623347
  -0.035712656
  0.024683367
  -0.009251414
  -0.0027734847
  -0.005042699
  -0.011669324
  0.018981237
  -0.0022304247
  -0.001624331
  0.020907806
  -0.005472622
  -7.458993E-4
  0.022575777
  0.040962234
  0.033824876
  0.0053206943
  -0.028575296
  0.008365708
  -0.0039695096
  0.022847306
  -0.010453903
  -0.009788008
  0.024941966
  -0.030204475
  -0.018451108
  8.638855E-4
  0.035609215
  -0.0041569946
  0.005595457
  -0.010906453
  0.004722682
  -0.008275199
  -5.2629133E-5
  -0.031031996
  -0.019692387
  0.015735807
  0.040470894
  0.0026538821
  -0.005430599
  -0.021851696
  -0.024618717
  -0.0060577043
  -0.028885616
  -0.0109387785
  -7.70143E-4
  0.021980997
  -0.010725434
  0.024941966
  0.024204956
  -0.012264104
  0.015412558
  0.004851982
  -0.003436147
  -0.0023564922
  0.020907806
  0.0018360597
  0.024230817
  -0.009548804
  -0.009529409
  0.011455978
  0.0026926722
  0.018360598
  0.018192507
  -0.004244272
  0.031264737
  0.0057085943
  -0.0030401659
  0.014804848
  0.0015136179
  -0.010492694
  0.014404018
  -0.0014020967
  0.006917549
  -0.008107109
  -0.0028882383
  0.011649928
  -0.038402095
  -0.013104553
  -0.028161537
  0.019692387
  -0.016899507
  -0.020662136
  -0.016214218
  -0.0013511848
  0.032143977
  0.008915233
  -0.051538974
  0.017856328
  0.043418933
  -0.026015157
  -0.017558938
  -0.0037884894
  -0.014817778
  0.003242197
  0.013576498
  -0.020338887
  -0.004884307
  0.004341247
  0.008986348
  -0.006613694
  0.036229856
  0.018425247
  0.015839247
  -0.010311673
  0.010137118
  0.0043961992
  0.0037044445
  -0.022743868
  -0.009025139
  -0.031394035
  0.003099967
  -0.009180299
  -0.0026571145
  -0.008404499
  0.034419656
  0.014429878
  -6.161952E-4
  -0.007408889
  0.012955858
  -0.030049317
  -0.025394516
  -0.028627016
  0.010020749
  -0.005970427
  -0.016808998
  -0.019834617
  -0.009012208
  0.0062225615
  0.005139674
  -0.016808998
  0.008747144
  -0.014908288
  -0.030747537
  -0.005918707
  0.017248617
  -0.014649688
  -0.012192989
  -0.028109817
  0.0048099593
  -0.013899748
  0.012852418
  0.021812906
  -0.008941093
  -0.006251654
  -2.5274107E-4
  -0.019925127
  -0.015166888
  -0.0051558367
  -0.015645297
  -0.029480396
  -0.007770929
  -0.010641389
  -0.0110874735
  0.025071267
  -0.017649448
  0.027334016
  -0.006665414
  0.004030927
  -0.0042022495
  -0.013654078
  -0.011171519
  -0.035764374
  -0.025355726
  0.004502872
  0.033566274
  0.009762148
  0.0111133335
  0.014248858
  -0.037315976
  0.021955136
  0.0027912634
  0.009180299
  -0.0096910335
  0.0025779183
  0.003494332
  0.008798864
  0.015942687
  0.001721306
  -0.012341684
  0.020649208
  0.030747537
  0.021735327
  0.006801179
  -0.0032906844
  -0.0024502347
  -7.976193E-4
  0.050426994
  -0.0030692583
  0.027308157
  0.005123512
  0.020804368
  0.006109424
  -0.019045888
  0.009606989
  -0.008333384
  0.020843158
  0.004127902
  -0.0022223433
  -0.0012752211
  2.2223435E-4
  0.004667729
  0.009891449
  0.021567237
  0.012024898
  -0.013039903
  0.007480004
  6.897346E-4
  0.022562847
  -0.006930479
  -0.023804126
  0.027023695
  -0.0032955334
  0.005336857
  9.3984924E-4
  -0.0015386698
  2.6486293E-4
  0.021580167
  -0.025407447
  0.005191394
  0.021179337
  6.650868E-4
  9.4631425E-4
  0.012412799
  -0.019498438
  0.043884415
  -0.011669324
  0.014714338
  0.020028567
  0.030230336
  0.0060964944
  0.017028807
  0.014494528
  -0.041091535
  -0.006283979
  -0.010887058
  -0.007505864
  0.020972457
  0.014171278
  0.004800262
  0.029480396
  0.035531636
  0.011333143
  0.010680178
  -0.0055502015
  0.008630774
  0.008087714
  -0.016899507
  0.014675548
  -0.0042410395
  -0.0028623783
  0.001882931
  -0.0025035709
  4.85279E-4
  -0.012658468
  -0.009380714
  -0.004625707
  0.0036591894
  0.016821928
  -0.014145418
  -0.010007818
  -0.021812906
  -0.0049845143
  -0.020183727
  0.018942447
  -0.0033294745
  0.007783859
  0.012904138
  0.007602839
  0.0051687667
  0.039488215
  -0.014688478
  0.016705558
  -0.002272447
  0.0049037016
  0.0010788467
  0.007654559
  -5.798296E-4
  -0.011798623
  0.030980276
  -0.015800457
  -0.014649688
  -0.022084437
  -0.017571868
  -0.018903658
  0.026894396
  0.013964398
  -0.007447679
  0.0014287648
  0.027954657
  0.019976847
  -0.030023456
  -0.008598449
  0.012936464
  0.0132079935
  -0.008184689
  0.002102741
  0.017804608
  0.010731898
  0.032583594
  0.0110874735
  -0.020830227
  -0.019032957
  -0.031342316
  0.0021690072
  0.039617516
  0.021334497
  -0.016265938
  -4.9457245E-4
  0.009464758
  -0.0041182046
  0.0058540567
  0.0038628369
  0.025497956
  -3.0345088E-4
  0.013744588
  -0.008359244
  0.030101037
  0.014649688
  -0.017908048
  -0.0041311346
  -0.029842436
  -0.023829987
  0.016149567
  0.0022546684
  -0.0123610785
  0.0028947033
  0.025562607
  0.047401372
  6.392268E-4
  0.026170317
  0.008288129
  0.030618235
  0.040315736
  0.003688282
  0.002096276
  -0.009671639
  -0.005915474
  -0.004380037
  0.0024890245
  0.013873888
  -0.005459692
  -0.013511848
  -0.0060738665
  0.0077127437
  0.007473539
  0.020054428
  2.9355136E-4
  -0.007130894
  6.6751114E-4
  -0.014998798
  -3.145626E-4
  -0.007790324
  0.013460129
  -0.009244949
  0.010958173
  -0.016860718
  -0.009303134
  -0.017041737
  0.023623107
  -0.021618957
  -0.013156273
  -0.0020429397
  -0.0038078844
  -0.045642894
  0.0049133995
  -0.011501233
  0.042306956
  -3.2405808E-4
  -0.0015103854
  -0.005766779
  -0.028161537
  -0.015761668
  -0.018645057
  -0.012257638
  -5.035628E-5
  -1.7162552E-4
  0.007783859
  0.022536987
  0.022575777
  0.023519667
  -3.6123183E-4
  -0.008624309
  0.005110582
  0.0035040295
  0.0043638744
  -0.0085919835
  -0.024735086
  -0.025821207
  -0.040962234
  0.031807795
  0.021114687
  -0.013356688
  0.0013091624
  -0.015141028
  -0.025950506
  -0.0120119685
  0.016550398
  -0.004412362
  -0.004050322
  -0.016692627
  0.020106148
  -0.024825597
  0.0019588948
  -0.017377917
  0.012774838
  9.236867E-4
  0.0045513595
  -0.011552953
  0.022407686
  0.0024760948
  0.004703287
  0.002063951
  -0.024941966
  0.009270809
  0.018192507
  0.020468187
  0.016175428
  0.004360642
  -0.0063001416
  0.024515277
  0.020636277
  -0.013809238
  0.0029431907
  -0.006271049
  -0.0040147644
  -0.026661657
  0.025342796
  -0.0058281966
  -0.027463317
  0.023868777
  -0.007512329
  -0.012212384
  -0.032738756
  -0.003830512
  0.018657988
  0.0054564592
  0.014119558
  -0.024566997
  -0.031213015
  -0.016498677
  -0.0022288084
  0.0064359065
  -0.0014029049
  -0.009904379
  -0.007990739
  0.020791437
  0.002737927
  -0.005605154
  -0.031523336
  -0.021851696
  0.007428284
  0.026816817
  0.012393403
  2.660751E-4
  0.005123512
  -0.009846194
  -0.013421338
  -0.0011087473
  0.004528732
  -0.013977328
  -0.0049295616
  0.011759833
  0.039255474
  -0.010680178
  0.017222758
  0.007842044
  0.040212296
  0.014235928
  -0.028756317
  8.9459424E-4
  -0.0025068035
  -0.013964398
  -0.024838526
  0.027308157
  -0.002453467
  0.038402095
  -0.0065328814
  0.013770448
  0.019007098
  0.028782176
  -0.002057486
  -0.029118355
  -0.014158348
  -0.009160903
  0.016615048
  -0.013240318
  -0.013938538
  0.028937336
  -0.002097892
  -0.028161537
  0.024256676
  -0.008676029
  -0.012542098
  -0.007415354
  0.008740678
  -0.009257879
  0.005314229
  -1.2191322E-5
  0.020132007
  -0.022355966
  -0.011940854
  0.006587834
  0.0050653266
  -0.008714818
  -0.019860478
  -0.013537708
  0.003240581
  -0.032428436
  0.0045901495
  0.0017261547
  -0.020364746
  -0.0034652394
  0.015903898
  0.0018344435
  -0.0060738665
  -0.0047517745
  -0.036514316
  -0.031419896
  -0.009322529
  0.012212384
  0.008831189
  0.015347908
  -0.017623588
  -0.012917068
  -6.190237E-4
  0.015076378
  0.041065674
  -0.009710428
  0.016847787
  0.004816424
  -0.001566146
  -0.011669324
  0.0036947469
  0.0050879545
  0.013201528
  0.030825116
  -0.009374249
  0.0082687335
  -0.031161295
  0.010537948
  0.033747297
  -0.013395478
  -0.031807795
  0.023817057
  0.009425969
  0.005433832
  -0.007673954
  -0.011488304
  -0.015528928
  0.006322769
  -5.7094026E-4
  0.0020671834
  -0.0011241017
  -0.036488455
  -0.05156483
  0.023118837
  -0.0042604343
  0.026183246
  -0.007518794
  -0.017714098
  -0.0013907829
  0.0020413236
  -0.035066154
  0.005501714
  0.015283258
  -0.008876444
  -0.006936944
  0.006303374
  -3.986076E-4
  -0.009800939
  -0.037005655
  -0.005055629
  0.003216337
  0.030411355
  -0.021851696
  -0.010305208
  -0.0040955767
  0.021334497
  -0.008120039
  0.0031743145
  -0.016808998
  3.973954E-4
  -0.004489942
  -0.016563328
  0.017649448
  -0.0028688433
  -0.026415987
  0.0023063885
  -4.0264823E-4
  -0.004544894
  -0.05466803
  -0.031445757
  9.2126237E-4
  -0.009884983
  -0.026377195
  0.012697258
  0.0026296384
  0.011921458
  0.019601878
  -0.007906694
  -0.012548563
  0.009005744
  0.006820574
  0.024385978
  6.5902586E-4
  0.0021189034
  -0.024243746
  -0.0020203122
  -0.013039903
  -0.025976367
  0.019291557
  -0.019304488
  -0.031316455
  -0.0055889916
  -0.008430359
  0.018787287
  -0.016369378
  -0.019938057
  0.021683607
  -0.010182373
  0.003487867
  -0.009283739
  -0.008527334
  0.011766299
  -0.006872294
  0.003403822
  0.012173593
  -2.0304137E-4
  -0.025549676
  -0.032531876
  -0.0024550834
  0.002367806
  -0.037419416
  -0.021011246
  -0.020739717
  0.046858314
  -0.019537227
  0.024217887
  -0.022019787
  -0.016964158
  -0.034238636
  0.023623107
  -0.0068787592
  -0.031497475
  0.0010780386
  0.038531393
  0.034652397
  0.016472818
  0.0091673685
  -0.014339368
  -0.0134084085
  -0.030695817
  -0.035117876
  -0.009949634
  0.0060867965
  0.043858554
  0.011152123
  -0.017778747
  -0.008650169
  -0.023312787
  -0.031885374
  -0.012283498
  0.014222998
  0.017830467
  -0.021024177
  0.025355726
  0.008410964
  0.014740198
  -0.0060415417
  0.007939019
  -0.037109096
  0.011740439
  0.036514316
  0.011843879
  -0.010007818
  -0.0063550943
  -0.036203995
  -0.023661897
  -0.006827039
  -0.008915233
  -0.013589428
  0.026765097
  0.027385736
  0.028032236
  -0.027178856
  0.038065914
  0.021593098
  -0.0044996394
  0.012063689
  0.0039565796
  -0.023804126
  -0.034781694
  0.025782416
  -0.021812906
  -4.8043026E-4
  -0.0027815658
  0.011035753
  0.0120119685
  -0.008902304
  -0.022575777
  0.016382307
  -0.024321327
  0.013317898
  -0.019498438
  -0.010104794
  0.014184208
  0.0058443593
  -0.004344479
  -0.011061613
  0.0033876596
  -0.020222517
  -0.005795872
  0.020998318
  -0.010660783
  -0.008760074
  -0.004160227
  0.015141028
  -0.020869017
  0.015231538
  8.2024676E-4
  -0.031730216
  -0.035273034
  0.052935414
  0.010576739
  -0.0016808998
  -0.008223479
  0.027178856
  0.0063647917
  0.0082428735
  -0.025459167
  -0.0041182046
  -0.018011488
  0.015257398
  0.008132969
  -0.037962474
  -0.015968548
  0.0027654034
  -0.010654318
  -0.033255957
  -0.0056407116
  0.17688237
  -0.019407928
  0.026209107
  0.038117636
  0.0044091293
  0.003539587
  0.015580648
  0.006872294
  0.0154772075
  -0.010576739
  -0.018619196
  -0.0062419567
  -0.027334016
  0.0042959917
  0.038453814
  -0.011236168
  -0.023778267
  -0.023868777
  0.007214939
  0.0035040295
  -0.0040276945
  -0.024282537
  -0.016434027
  -0.0012639073
  0.017636517
  -0.006794714
  -0.024321327
  -0.0043250844
  0.003371497
  -1.9879872E-4
  0.007124429
  -0.042436253
  -0.009044534
  0.011818019
  -0.0014231079
  -0.015890967
  0.005954264
  0.008061854
  0.016692627
  0.019782897
  0.012180058
  0.016783137
  0.002957737
  0.0039953697
  -0.018037347
  0.038143493
  0.002219111
  -0.025265217
  -0.010751293
  -0.0028833896
  -0.032506015
  0.0132079935
  0.032893915
  0.024799736
  -0.018890727
  0.015347908
  -0.013111019
  0.002432456
  -0.013667008
  0.036669474
  -0.010537948
  0.029040776
  -0.021618957
  0.030902695
  -0.015774598
  0.0044414545
  -0.024618717
  0.028833896
  0.013001113
  -0.009232019
  -0.027411597
  -0.025433306
  -0.007648094
  0.003998602
  -0.012820093
  -0.023131767
  -0.0046289396
  1.3697716E-4
  0.010182373
  0.015386698
  0.014688478
  -0.031109575
  -0.025730696
  -0.0058863815
  -0.034212776
  -0.008087714
  0.036747053
  0.018464038
  0.022226667
  -0.041453574
  2.3375012E-4
  -0.024605786
  0.014494528
  0.009678104
  -0.0060835644
  0.035686795
  -0.024954896
  0.007622234
  -0.021463796
  -0.012451588
  -0.005000677
  -0.014804848
  0.025342796
  0.012102478
  -0.026325475
  -0.022084437
  -0.016382307
  0.020183727
  0.010770689
  -0.027411597
  -0.0025035709
  3.0345088E-4
  0.017882187
  -0.014391088
  0.018464038
  -0.012108943
  -0.015839247
  -0.015386698
  7.357977E-4
  -0.027463317
  0.007790324
  -0.024489416
  0.0022288084
  0.012257638
  -0.032635316
  -0.0012913835
  0.0064746966
  0.019330347
  0.008928164
  -0.023480877
  0.014029048
  -0.029118355
  -0.0059251715
  3.830512E-4
  -0.0054273666
  0.0032308833
  -0.018916588
  -0.013537708
  -0.0089928135
  -0.008359244
  -0.018968306
  -0.010479763
  0.016240077
  -0.0032535107
  0.015244468
  0.0020558697
  0.007460609
  0.013369618
  -0.001992836
  0.009594059
  0.0027346946
  -0.019666526
  -0.011818019
  -0.029920015
  -0.0041343668
  0.0060706344
  0.0036462594
  -0.011649928
  0.018037347
  -0.0128847435
  -0.021838767
  -0.007835579
  0.015231538
  -0.017727027
  0.0051849294
  -0.012063689
  -0.16146982
  0.035350613
  0.038195215
  -0.010279348
  0.018851938
  -0.016485747
  0.024179097
  0.013977328
  -0.0044867094
  -0.0051687667
  0.019989777
  -0.0055178767
  -0.0049974443
  -0.05425427
  0.009477689
  -0.017662378
  0.0014101779
  0.041143253
  0.042513832
  0.013421338
  0.003533122
  -0.010932313
  0.027721915
  -0.017662378
  0.003804652
  0.017623588
  -0.011300818
  -9.19242E-6
  0.003500797
  0.003494332
  -0.004864912
  -0.003849907
  -0.002122136
  -0.015890967
  -0.0032842197
  -0.009522944
  0.0036397944
  -0.025653116
  -0.005430599
  -0.0010190455
  0.011391329
  0.017610658
  -0.0051558367
  0.015464278
  0.013356688
  0.029687276
  0.012470983
  -0.014326438
  0.0019508135
  -0.005188162
  0.014145418
  -7.2327175E-4
  0.039203756
  0.021321567
  -0.015658228
  9.018674E-4
  -0.0037755594
  0.012606748
  -2.3375012E-4
  -0.019071747
  0.014145418
  -6.982199E-4
  0.014546248
  -0.009833263
  -4.127498E-4
  -0.012897673
  -0.012690793
  0.0014093698
  -0.018994167
  0.0091415085
  -0.033695575
  -0.025278147
  0.025950506
  -0.017054668
  0.015166888
  0.019394998
  0.0048455168
  -0.018580407
  0.0052883695
  0.0040988093
  -0.036824636
  0.034755833
  -0.014662618
  0.007842044
  -0.006982199
  -0.016757278
  -0.004800262
  0.002615092
  -0.019692387
  -0.024799736
  0.030773396
  -0.024179097
  0.006051239
  -0.022963677
  0.0018021185
  0.021024177
  0.010718969
  -0.018489897
  0.008986348
  -8.808561E-4
  0.0058152666
  0.010137118
  -0.047065195
  0.014132488
  0.057409193
  0.012567958
  0.017856328
  0.002005766
  0.048487492
  -9.980343E-4
  0.0032648246
  -0.0027476246
  0.0051687667
  0.044660214
  0.0016728186
  0.030075176
  -0.0022562847
  -0.017533077
  0.017533077
  -0.026015157
  0.034083474
  0.008863513
  -0.030566515
  0.017533077
  0.006839969
  0.004735612
  -0.1151287
  -0.007932554
  0.002628022
  0.028368415
  0.007874369
  -0.0033941246
  0.004664497
  0.026532356
  0.031730216
  0.032350857
  -0.05086661
  -0.025510887
  0.012399868
  -0.003247046
  0.026079806
  0.006122354
  -0.012044293
  0.007518794
  0.010803013
  0.015528928
  -0.004438222
  -0.007803254
  -0.013014043
  -0.010796549
  4.4568087E-4
  1.9293981E-4
  -0.031031996
  0.011061613
  0.014882428
  0.011914994
  0.012781303
  -0.017183967
  0.0025730697
  -0.008811794
  -0.014843638
  -0.006452069
  -0.014235928
  0.005663339
  -0.012212384
  -0.021425007
  -0.008501474
  2.2364856E-4
  0.015709948
  -0.017416708
  0.034367934
  -0.016033199
  -0.040626053
  0.0024437697
  -0.034859274
  -0.029661415
  -0.020726787
  -0.010880593
  9.851042E-4
  -0.021567237
  -0.0032793707
  -0.021334497
  0.019317416
  -0.010130653
  0.0049004694
  -0.006872294
  0.011940854
  0.017002948
  -0.014261788
  0.022187877
  0.040703636
  0.012677863
  0.0011855192
  -0.008158829
  0.012761909
  -0.019601878
  0.003339172
  -0.012451588
  0.007990739
  0.010628458
  -0.022614567
  0.0051170466
  -0.045306712
  -0.0037044445
  -0.014572108
  -0.012005503
  0.0078937635
  0.0023047721
  -0.0075511187
  0.011158588
  0.0049812817
  0.019239837
  0.0063389316
  -0.006846434
  0.015800457
  -0.044763654
  0.013576498
  0.020351818
  0.0010853118
  0.010641389
  -0.010796549
  0.019045888
  0.019886337
  0.016304728
  0.013149808
  -0.010402184
  -0.038531393
  0.009510013
  -0.048487492
  0.044039574
  0.015050518
  0.0029270283
  0.019304488
  0.013485988
  0.010854733
  0.020093217
  -0.0028462159
  0.0028316695
  0.007266659
  -0.006009217
  -0.022174947
  -0.016408168
  -0.017481357
  -0.023623107
  0.027152997
  0.013667008
  0.017119318
  0.024786806
  4.549743E-4
  0.029376956
  0.022304246
  0.012419263
  -0.020313026
  -0.014416948
  -0.008566123
  0.017196897
  -0.004826122
  -0.0036010046
  0.016589187
  -0.021903416
  -0.006620159
  0.0053594843
  0.013136879
  0.0050944192
  5.8993115E-4
  0.0016526154
  0.014688478
  -0.0024809435
  -9.543955E-4
  -0.035324756
  -0.018231297
  5.3376646E-4
  -0.010124189
  0.012891208
  0.005931637
  -0.019925127
  0.024321327
  -0.0012388554
  0.035790235
  0.007473539
  0.011895598
  -0.039384775
  -0.012567958
  0.009781544
  0.016563328
  -0.011999038
  -0.025239356
  -0.040496755
  0.025847066
  -0.0057118265
  0.021386217
  -7.5357646E-5
  -0.021774117
  -0.021231057
  -0.0030013758
  0.005462924
  0.0059898216
  -0.022149086
  0.015619438
  -0.026713377
  0.008410964
  -0.011100403
  0.025135916
  0.0026506495
  -0.022045648
  0.032868054
  0.0010513705
  0.027928796
  0.014675548
  0.002750857
  -0.031057855
  0.011100403
  0.027825356
  -0.0043380144
  6.157912E-4
  0.035764374
  0.021308636
  -6.0730585E-4
  -0.031859517
  0.023959287
  -0.030385496
  -0.005782942
  0.012354613
  0.012192989
  -0.009322529
  -0.013123948
  0.019950988
  1.524073E-5
  0.007059779
  -0.0062160967
  -0.0047420766
  0.006678344
  -0.0114365835
  -0.034264494
  0.013822168
  -0.007958414
  -0.010899989
  -0.0013883585
  4.6790432E-4
  -0.012807163
  0.008676029
  0.028316695
  -0.023209346
  0.0011540024
  -0.020287167
  0.002621557
  -0.005052397
  0.029713135
  0.016640907
  4.3719556E-4
  0.009749219
  -0.006936944
  0.011397793
  0.037134957
  0.008197619
  -0.011947318
  0.014222998
  -0.010292279
  0.0032211859
  -0.0025132685
  0.0015346291
  -0.027799496
  0.013641148
  0.0048455168
  0.034083474
  0.015076378
  0.004515802
  0.06377075
  -0.024450626
  -0.0010133886
  0.010537948
  0.0020849623
  -0.0048875394
  0.0023015398
  -0.018360598
  -0.016071988
  -0.012632608
  -0.0033019984
  0.013136879
  -0.013744588
  -5.149271E-5
  -0.032454297
  0.024993686
  0.002872076
  8.509555E-4
  -0.012445123
  0.0026587308
  0.026558217
  -0.0025601396
  0.041815612
  -4.8770336E-4
  -0.013796308
  -2.6769136E-4
  0.018903658
  3.008245E-4
  0.007842044
  -0.035919536
  0.009943169
  0.024812667
  -0.043315493
  -0.010790084
  0.0032971494
  0.004050322
  0.014546248
  0.009374249
  0.0014748279
  0.011177983
  -0.007408889
  0.021670677
  -0.0123610785
  -0.009988423
  -0.0040341592
  0.004276597
  -0.022317177
  -0.026920257
  -0.017171038]}

Extracting the relevant knowledge (cont.)

(-> "What is the average weight of a banana fruit?"
    extract
    :info)
{:text
 "By wikipedia:\n The banana fruits develop from the banana heart, in a large hanging cluster, made up of tiers (called \"hands\"), with up to 20 fruit to a tier. The hanging cluster is known as a bunch, comprising 3–20 tiers, or commercially as a \"banana stem\", and can weigh 30–50 kilograms (66–110 lb). Individual banana fruits (commonly known as a banana or \"finger\") average 125 grams (4+1⁄2 oz), of which approximately 75% is water and 25% dry matter (nutrient table, lower right)."}

Connecting everything

(let [question "What is the average weight of a banana fruit?"]
  (create-chat-completion
   {:model "gpt-3.5-turbo"
    :messages [{:role "system"
                :content (-> question
                             extract
                             :info
                             :text)}
               {:role "user"
                :content question}]}))
{:id "chatcmpl-7S43FX5MtIIaBpFR2dcIWavhGCu9m",
 :object "chat.completion",
 :created 1686923113,
 :model "gpt-3.5-turbo-0301",
 :usage {:prompt_tokens 147, :completion_tokens 20, :total_tokens 167},
 :choices
 [{:message
   {:role "assistant",
    :content
    "The average weight of a banana fruit is around 125 grams (4+1/2 oz)."},
   :finish_reason "stop",
   :index 0}]}

More examples

(defn random-vector [means]
  (-> means
      (fun/+ (dtype/make-reader :float32 (count means) (rand)))
      dtype/clone
      vec))
(comment

  (dotimes [i 4]
    (-> embedding-dimension
        range
        random-vector
        (remember-vector! (str "A" i) {}))
    (-> embedding-dimension
        range
        reverse
        dtype/->float-array
        random-vector
        (remember-vector! (str "B" i) {})))

  (-> vald-client
      (vald/search {:num 40}
                   (range embedding-dimension))))
source: projects/vald/notebooks/scicloj/scrapbook/vald.clj